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DETAILED ACTION 

Request for Continued Examination 

1. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 

1 .17(e) has been timely paid, the finality of the previous Office action has been 
withdrawn pursuant to 37 CFR 1.114. 

2. Amendment received June 19, 2006 has been entered into record. Claims 1-41 remain 
pending. 

Response to Amendment 

3. This office action is in response to the applicants Amendment filed on June 19, 2006. 
Claims 1-41 are presented for further consideration and examination. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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5. Claims 1-5, 12-16. and 27-29 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Dunn et al. (US00599961 2A), in view of Has et aL (US0062301 37B1 ), and further 
in view of Vander Molen (US004520576). 



6. With regard to claim 1 . Dunn discloses, 

• a first connection port to allow a speech-based conversation to occur over the 
home-based broadband connection to the Internet network; (Dunn, col. 2, lines 
16-27, lines 32-42; col.3, lines 53-56; col. 15, lines 39-57; fig.2) 

Dunn discloses, "our solution is provide a special server/gateway for broadband 
networks, such as cable television networks, and unique adapters for residences 
served by these networks. In its preferred form, our adapter is a card internally 
installed in a computer. In addition to the computer, this adapter connects to the 
PSTN, the broadband network (or a modem connecting to that network), and one 
or more telephones" (Dunn, col.2, lines 16-22). Hence, Dunn teaches of a 
computer that includes an adapter containing ports for connecting to the Internet 
through either the broadband network of the service provider or through the 
public switched telephone network (PSTN). 

• a second connection port to allow a speech-based conversation to occur over a 
public switched telephone network (PSTN); and (Dunn, col.2, lines 16-27, lines 
32-42; col.3, lines 53-56; col.15, lines 39-57; fig.2) 

Dunn discloses, "our solution is provide a special server/gateway for broadband 
networks, such as cable television networks, and unique adapters for residences 
served by these networks. In its preferred form, our adapter is a card internally 
installed in a computer. In addition to the computer, this adapter connects to the 
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PSTN, the broadband network (or a modem connecting to that network), and one 
or more telephones" (Dunn, col.2, lines 16-22). Hence, Dunn teaches of a 
computer that includes an adapter containing ports for connecting to the Internet 
through either the broadband network of the service provider or through the 
public switched telephone network (PSTN). 
However, Dunn does not explicitly teaches, 

• a plurality of speech engines that recognize speech and synthesize speech to 
allow the speech-based conversations to occur over the first connection port and 
the second connection port. 

Has teaches, 

• a plurality of speech engines that recognize speech and synthesize speech to 
allow the speech-based conversations to occur over the first connection port and 
the second connection port. (Has, col.2, line 10 - col.4, line 67) 

Has discloses, "a first device for inputting at least two speech signals designating 
the operating functions and/or the components of the household appliance; a 
second device, operatively connected to the first device, for recognizing the 
operating functions and/or the components designated by the speech signals; a 
third device, for converting the speech signals, after being recognized, into a 
given control command to operate the household appliance.. . and a central 
computer connected to the household appliance, at least one of the first, second, 
and third devices being assigned to the central computer, the first, second, and 
third devices being configured such that the speech signals, being input in a 
direct succession for selecting the operating functions and/or components of the 
household appliance" (Has, col.2, line 67 - col. 3, line 16). Hence, Has teaches 
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of a speech recognizing component in the central computer used to control the 

household appliance. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine the teachings of Has with the teachings of Dunn 
"to provide a household appliance which overcomes the above-mentioned 
disadvantages of the heretofore-known appliances of this general type and which 
provides a simple, reliable, and rapid speech-controlled operation for the household 
appliance" (Has, col.2, lines 10-14) "by allowing for seamless and effective 
integration of telephone services into cable networks and/or other broadband 
networks" (Dunn, col.2, lines 11-13); through the use of a central computer that 
includes an adapter containing ports for connecting to the Internet through either the 
broadband network of the service provider or through the public switched telephone 
network (PSTN). 

However, Dunn and Has do not explicitly teaches, 

• a plurality of speech engines that recognize speech and synthesize speech to 
allow the speech-based conversations to occur over the first connection port and 
the second connection port. 

Vander Molen teaches, 

• a plurality of speech engines that recognize speech and synthesize speech to 
allow the speech-based conversations to occur over the first connection port and 
the second connection port. (Vander Molen, col.2, lines 15-68; col.3, line 14 - 
col. 4, line 47) 

Vander Molen discloses, "the basic components of the system comprise a 
speech recognition module 50, a speech synthesis module 52, a master control 
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microcomputer 53 and the appliance control system 56" (Vander Molen, col.4, 
lines 2-6). Hence, Vander Molen teaches of a system that includes a speech 
recognition module as well as a speech synthesis module. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine the teachings of Vander Molen with the 
teachings of Dunn and Has to provide a conversational voice command control 
system "household appliance which overcomes the above-mentioned disadvantages 
of the heretofore-known appliances of this general type and which provides a simple, 
reliable, and rapid speech-controlled operation for the household appliance" (Has, 
col.2, lines 10-14) "by allowing for seamless and effective integration of telephone 
services into cable networks and/or other broadband networks" (Dunn, col.2, lines 
11-13); through the use of a central computer that includes an adapter containing 
ports for connecting to the Internet through either the broadband network of the 
service provider or through the public switched telephone network (PSTN). 



7. With regard to claim 27 , Dunn discloses, 

• communicating with a first communication device located on the Internet network 
so that a speech-based conversation can occur over the home-based connection 
to the Internet network; (Dunn, col.2, lines 16-27, lines 32-42; col.3, lines 53-56; 
col. 15, lines 39-57; fig.2) 

Dunn discloses, "our solution is provide a special server/gateway for broadband 
networks, such as cable television networks, and unique adapters for residences 
served by these networks. In its preferred form, our adapter is a card internally 
installed in a computer. In addition to the computer, this adapter connects to the 
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PSTN, the broadband network (or a modem connecting to that network), and one 
or more telephones" (Dunn, col.2, lines 16-22). Hence, Dunn teaches of a 
computer that includes an adapter containing ports for connecting to the Internet 
through either the broadband network of the service provider or through the 
public switched telephone network (PSTN). 

• communicating with a second communication device located on a public 
switched telephone network (PSTN) so that the speech-based conversation can 
occur over the public switched telephone network; and (Dunn, col.2, lines 16-27, 
lines 32-42; col.3, lines 53-56; col. 15, lines 39-57; fig.2) 

Dunn discloses, "our solution is provide a special server/gateway for broadband 
networks, such as cable television networks, and unique adapters for residences 
served by these networks. In its preferred form, our adapter is a card internally 
installed in a computer. In addition to the computer, this adapter connects to the 
PSTN, the broadband network (or a modem connecting to that network), and one 
or more telephones" (Dunn, col.2, lines 16-22). Hence, Dunn teaches of a 
computer that includes an adapter containing ports for connecting to the Internet 
through either the broadband network of the service provider or through the 
public switched telephone network (PSTN). 
However, Dunn does not explicitly teaches, 

• recognizing speech and synthesizing speech to allow the speech-based 
conversation to occur over the Internet network and the public switched 
telephone network; 

• wherein the recognizing of speech includes an understanding of speech. 
Has teaches, 
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• recognizing speech and synthesizing speech to allow the speech-based 
conversation to occur over the Internet network and the public switched 
telephone network; (Has, col.2, line 10 - col.4, line 67) 

• wherein the recognizing of speech includes an understanding of speech. (Has, 
col.2, line 10 -col.4, line 67) 

Has discloses, "a first device for inputting at least two speech signals designating 
the operating functions and/or the components of the household appliance; a 
second device, operatively connected to the first device, for recognizing the 
operating functions and/or the components designated by the speech signals; a 
third device, for converting the speech signals, after being recognized, into a 
given control command to operate the household appliance . . . and a central 
computer connected to the household appliance, at least one of the first, second, 
and third devices being assigned to the central computer, the first, second, and 
third devices being configured such that the speech signals, being input in a 
direct succession for selecting the operating functions and/or components of the 
household appliance" (Has, col.2, tine 67 - col. 3, line 16). Hence, Has teaches 
of a speech recognizing component in the central computer used to control the 
household appliance. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine the teachings of Has with the teachings of Dunn 
"to provide a household appliance which overcomes the above-mentioned 
disadvantages of the heretofore-known appliances of this general type and which 
provides a simple, reliable, and rapid speech-controlled operation for the household 
appliance" (Has, col.2, lines 10-14) "by allowing for seamless and effective 
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integration of telephone services into cable networks and/or other broadband 
networks" (Dunn, col.2, lines 11-13); through the use of a central computer that 
includes an adapter containing ports for connecting to the Internet through either the 
broadband network of the service provider or through the public switched telephone 
network (PSTN). 

However, Dunn and Has do not explicitly teaches, 

• recognizing speech and synthesizing speech to allow the speech-based 
conversation to occur over the Internet network and the public switched 
telephone network; 

Vander Molen teaches, 

• recognizing speech and synthesizing speech to allow the speech-based 
conversation to occur over the Internet network and the public switched 
telephone network; (Vander Molen, col.2, lines 15-68; col. 3, line 14 - col.4, line 
47) 

Vander Molen discloses, "the basic components of the system comprise a 
speech recognition module 50, a speech synthesis module 52, a master control 
microcomputer 53 and the appliance control system 56" (Vander Molen, col.4, 
lines 2-6). Hence, Vander Molen teaches of a system that includes a speech 
recognition module as well as a speech synthesis module. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine the teachings of Vander Molen with the 
teachings of Dunn and Has to provide a conversational voice command control 
system "household appliance which overcomes the above-mentioned disadvantages 
of the heretofore-known appliances of this general type and which provides a simple, 
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reliable, and rapid speech-controlled operation for the household appliance" (Has, 
col.2, lines 10-14) "by allowing for seamless and effective integration of telephone 
services into cable networks and/or other broadband networks" (Dunn, col.2, lines 
11-13); through the use of a central computer that includes an adapter containing 
ports for connecting to the Internet through either the broadband network of the 
service provider or through the public switched telephone network (PSTN). 



8. With regard to claims 2 and 28 % Dunn, Has, and Vander Molen disclose, 

• wherein a user connects to the home-based computer via the broadband 

connection in order to provide at least one home appliance voice command, said 
home-based computer further comprising: 

■ an appliance control software module that controls at least one home 
appliance based upon the user's voice command. (Dunn, col.2, lines 16-27, 
lines 32-42; col.3, lines 53-56; col. 15, lines 39-57; fig.2; Has, col.2, line 10 - 
col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 - col.4, line 47) 



9. With regard to claims 3 and 29 , Dunn, Has, and Vander Molen disclose, 

• wherein the user uses a wireless communication device to connect to the home- 
based computer in order to provide the home appliance voice command. (Dunn, 
col.2, lines 16-27, lines 32-42; col.3, lines 53-56; col. 15, lines 39-57; fig.2; Has, 
col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 - 
col.4, line 47) 



10. With regard to claims 4-5 . Dunn, Has, and Vander Molen disclose, 
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• wherein a user connects to the home-based computer over the second 
connection port in order to provide at least one home appliance voice command, 
said home-based computer further comprising: 

■ an appliance control software module that controls at least one home 
appliance based upon the user's voice command received over the second 
connection port. (Dunn, coi.2, lines 16-27, lines 32-42; col.3, lines 53-56; 
col. 15, lines 39-57; fig.2; Has, col.2, line 10 - col.4, line 67; Vander Molen, 
col.2, lines 15-68; col.3, line 14 - col.4, line 47) 

• wherein the user uses a plain telephone connected to the PSTN in order to 
provide the home appliance voice command over the second connection port. . 
(Dunn, col.2, lines 16-27, lines 32-42; col.3, lines 53-56; col.15, lines 39-57; fig.2; 
Has, col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 
-col.4, line 47) 

1 1 . With regard to claims 12-16 , Dunn, Has, and Vander Molen disclose, 

• wherein the computer operates within a residential home of a user. (Dunn, col.2, 
lines 16-27, lines 32-42; col.3, lines 53-56; col.15, lines 39-57; fig.2; Has, col.2, 
line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 - col.4, 
line 47) 

• wherein the computer operates within SOHO environment. (Dunn, col.2, lines 16- 
27, lines 32-42; col.3, lines 53-56; col.15, lines 39-57; fig.2; Has, col.2, line 10 - 
col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 - col.4, line 47) 

• wherein the computer operates within a non-Internet Service Provider 
environment. (Dunn, col.2, lines 16-27, lines 32-42; col.3, lines 53-56; col.15, 
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lines 39-57; fig.2; Has, col.2, line 10 - col. 4, line 67; Vander Molen, col.2, lines 
15-68; col.3, line 14-col.4, line 47) 

• wherein the first connection port provides for voice data over a VoIP channel. 
(Dunn, col.2, lines 16-27, lines 32-42; col.3, lines 53-56; col. 15, lines 39-57; fig.2; 
Has, col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 
-col.4, line 47) 

• wherein the first connection port provides for voice data over a VoN channel. 
(Dunn, col.2, lines 16-27, lines 32-42; coi.3, lines 53-56; col. 15, lines 39-57; fig.2; 
Has, col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col.3, line 14 
-col.4, line 47) 

12. Claims 6-11 and 30-32 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Dunn et al. (US005999612A), in view of Has et al. (US006230137B1 ), further in view of 
Vander Molen (US004520576), and further in view of Kurganov et al. (US006721705B2). 

13. With regard to claims 6 and 30, Dunn, Has, and Vander Molen disclose, 

See claims 1 and 27 rejection as detailed above. 

However, Dunn, Has, and Vander Molen do not explicitly disclose, 

• a personal software application retrieval module that retrieves personal 
information from a software application based upon the personal software 
application voice command of the user. 

Kurganov teaches, 

• a personal software application retrieval module that retrieves personal, 
information from a software application based upon the personal software 
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application voice command of the user. (Kurganov, col.2, lines 59-63; col.5, lines 
48-53) 

Kurganov teaches of a system that includes a database containing user profile 
information to assist the system in searching and retrieving information according 
to the user's voice commands. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine the teachings of Kurganov with the teachings of 
Dunn, Has, and Vander Molen to enhance the system by including a database which 
contains user profile information to assist the system in searching and retrieving 
information according to the user's voice commands. 



14. With regard to claims 7-8 and 31-32. Dunn, Has, Vander Molen, and Kurganov disclose, 

• wherein the user uses a wireless communication device to connect to the home- 
based computer in order to provide the personal software application voice 
command. (Dunn, col.2, lines 16-27, lines 32-42; col. 3, lines 53-56; col. 15, lines 
39-57; fig.2; Has, col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; 
col. 3, line 14 - col.4, line 47; Kurganov, col.2, lines 59-63; col.5, lines 48-53) 

• wherein the software application is software selected from the group consisting of 
personal information management software, financial software, electronic mail 
software, and combinations thereof. (Dunn, col.2, lines 16-27, lines 32-42; col.3, 
lines 53-56; col. 15, lines 39-57; fig.2; Has, col.2, line 10 - col.4, line 67; Vander 
Molen, col.2, lines 15-68; col.3, line 14 - col.4, line 47; Kurganov, col.2, lines 59- 
63; col.5, lines 48-53) 
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15. With regard to claims 9-11. Dunn, Has, Vander Molen, and Kurganov disclose, 

• wherein a user connects to the home-based computer over the second 
connection port in order to provide at least one personal software application 
voice command, wherein the personal software application retrieval module 
controls at least one home appliance based upon the user's voice command 
received over the second connection port. (Dunn, col.2, lines 16-27, lines 32-42; 
col. 3, lines 53-56; col.15, lines 39-57; fig.2; Has, col.2, line 10 - col.4, line 67; 
Vander Molen, col.2, lines 15-68; col. 3, line 14 - col.4, line 47; Kurganov, col.2, 
lines 59-63; col.5, lines 48-53) 

• wherein the user uses a plain telephone connected to the PSTN in order to 
provide the home appliance voice command over the second connection port. 
(Dunn, col.2, lines 16-27, lines 32-42; col. 3, lines 53-56; col.15, lines 39-57; fig.2; 
Has, col.2, line 10 - col.4, line 67; Vander Molen, col.2, lines 15-68; col. 3, line 14 
- col.4, line 47; Kurganov, col.2, lines 59-63; col.5, lines 48-53) 

• wherein the software application is software selected from the group consisting of 
personal information management software, financial software, electronic mail 
software, and combinations thereof. (Dunn, col.2, lines 16-27, lines 32-42; col.3, 
lines 53-56; col.15, lines 39-57; fig.2; Has, col.2, line 10 - col.4, line 67; Vander 
Molen, col.2, lines 15-68; col.3, line 14 - col.4, line 47; Kurganov, col.2, lines 59- 
63; col.5, lines 48-53) 

1 6. Claims 17-26 and 33-41 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Dunn et al. (US005999612A), in view of Has et al. (US006230137B1 ), further in view of 
Vander Molen (US004520576), and further in view of Ball et al. (US006600736B1). 
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17. With regard to claims 17-26 and 33-41, Dunn and Vander Molen disclose, 

See claims 1 and 27 rejection as detailed above. 

However, Dunn, Has, and Vander Molen do not explicitly disclose, 

• a voice markup language management module connected to the Internet network 
in order to retrieve a voice markup language program to interact by a speech- 
based conversation with the user over the first and second connections. 

Ball teaches, 

• a voice markup language management module connected to the Internet network 
in order to retrieve a voice markup language program to interact by a speech- 
based conversation with the user over the first and second connections. (Ball, 
col. 14, lines 43-44) 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of 
the invention was made to combine Ball reference with Dunn and Vander Molen 
references to enhance the system by utilizing the voice markup language to format 
the information retrieved by the system at the user's voice command. 

Response to Arguments 

18. Applicant's arguments with respect to claims 1-41 have been considered but are moot in 
view of the new ground(s) of rejection. 

Conclusion 

19. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Thomas Duong whose telephone number is 571/272-391 1 . The 
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examiner can normally be reached on M-F 7:30AM - 4:00PM. If attempts to reach the 
examiner by telephone are unsuccessful, the examiner's supervisor, Jason D. Cardone 
can be reached on 571/272-3933. The fax phone numbers for the organization where 
this application or proceeding is assigned are 571/273-8300 for regular communications 
and 571/273-8300 for After Final communications. 



Thomas Duong (AU2145) 




August 19, 2006 Supervisory PE (AU2145) 



